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Abstract — This paper applies several concentration inequalities 
to prove concentration results for the crest factor of OFDM 
signals. The considered approaches are, to the best of our 
knowledge, new in the context of establishing concentration for 
OFDM signals. 

Index Terms — Concentration of measures, crest-factor, OFDM 
signals. 

I. Introduction 

Orthogonal-frequency-division-multiplexing (OFDM) is a 
modulation that converts a high-rate data stream into a number 
of low-rate steams that are transmitted over parallel narrow- 
band channels. OFDM is widely used in several international 
standards for digital audio and video broadcasting, and for 
wireless local area networks. For a textbook providing a survey 
on OFDM, see e.g. C] Chapter 19]. 

One of the problems of OFDM is that the peak amplitude 
of the signal can be significantly higher than the average 
amplitude. This issue makes the transmission of OFDM signals 
sensitive to non-linear devices in the communication path 
such as digital to analog converters, mixers and high-power 
amplifiers. As a result of this drawback, it increases the symbol 
error rate and it also reduces the power efficiency of OFDM 
signals as compared to single-carrier systems. Commonly, the 
impact of nonlinearities is described by the distribution of 
the crest-factor (CF) of the transmitted signal |5|, but its 
calculation involves time-consuming simulations even for a 
small number of sub-carriers. The expected value of the CF 
for OFDM signals is known to scale like the logarithm of 
the number of sub-carriers of the OFDM signal (see ||5], |]9] 
Section 4] and lfT4l ). 

In this paper, we consider two of the main approaches for 
proving concentration inequalities, and apply them to derive 
concentration results for the crest factor of OFDM signals. The 
first approach is based on martingales, and the other approach 
is Talagrand's method for proving concentration inequalities 
in product spaces. It is noted that some of these concentration 
inequalities can be derived using ideas from information theory 
(see, e.g., |6| and references therein). 

Considering the martingale approach for proving concentra- 
tion results, the Azuma-Hoeffding inequality is by now a well- 
known methodology that has been often used to prove con- 
centration of measures. It is due to Hoeffding [3 | who proved 
this inequality for a sum of independent and bounded random 



variables, and Azuma |1| who later extended it to bounded- 
difference martingales. In the context of communication and 
information theoretic aspects, Azuma's inequality was used 
during the last decade in the coding literature for establishing 
concentration results for codes defined on graphs and iterative 
decoding algorithms (see, [8J and references therein). Some 
other martingale-based concentration inequalities were also re- 
cently applied to the performance evaluation of random coding 
over non-linear communication channels |15|. McDiarmid's 
inequality is an improved version of Azuma's inequaUty in 
the special case where one considers the concentration of a 
function / : R" — R of n independent RVs when the variation 
of f{xi, . . . , Xn) w.r.t. each of its coordinates is bounded (and 
when all the other n — 1 components are kept fixed). Under 
this setting, it gives an improvement by a factor of 4 in the 
exponent. This inequality is applied in this paper in order to 
prove the concentration of the crest factor of OFDM signals 
around the expected value. 

A second approach for proving concentration inequalities 
in product spaces was developed by Talagrand in his seminal 
paper |12|. It forms in general a powerful probabilistic tool 
for establishing concentration results for coordinate-wise Liph- 
schitz functions of independent random variables (see also, 
e.g., |2, Section 2.4.2] and |6, Section 4]). This approach was 
used in |4| to prove concentration inequalities, in the large 
system limit, for a code division multiple access (CDMA) 
system. Talagrand's inequality is used in this paper to prove 
a concentration result (near the median) of the crest factor of 
OFDM signals, and it also enables to obtain an upper bound 
on the distance between the median and the expected value. 

A stronger concentration inequaUty for the crest factor of 
OFDM signals was introduced in |T Theorem 3] under some 
assumptions on the probability distribution of the considered 
problem (the reader is referred to the two conditions in ||5] 
Theorem 3], followed by f5 Corollary 5]). These requirements 
are not needed in the following analysis, and the derivation 
of the concentration inequalities here is rather simple and it 
provides some further insight to this issue. 

II. Some Concentration Inequalities 

In the following, we present briefly essential background on 
concentration inequalities that is required for the analysis in 
this paper. In the next section, we will apply these probabilistic 



tools for obtaining concentration inequalities for the crest 
factor of OFDM signals. 

A. Azuma 's Inequality 

Azuma's inequalit}0 forms a useful concentration inequality 
for bounded-difference martingales |1|. In the following, this 
inequality is introduced. 

Theorem 1: [Azuma's inequality] Let {-^fc, -T^fcl^^o ^ 
discrete-parameter real-valued martingale sequence such that 
for every A: G N, the condition \Xk — Xk-i \ < dk holds a.s. 
for some non-negative constants {dfcjfcLi- Then 

„2 \ 

Vr > 0. (1) 



P(|X„-Xo|>r)<2cxp - 



The concentration inequality stated in Theorem [T] was 
proved in |3l for independent bounded random variables, 
followed by a discussion on sums of dependent random 
variables; this inequality was later derived in [IJ for bounded- 
difference martingales. The reader is referred, e.g., to ID for 
a proof. 

B. A Refined Version of Azuma's Inequality 

The following refined version of Azuma's inequality was 
introduced in |10| (which includes some other approaches for 
refining Azuma's inequality). 

Theorem 2: Let {Xk, -T^fcl^Lo ^ discrete-parameter real- 
valued martingale. Assume that, for some constants d, ct > 0, 
the following two requirements are satisfied a.s. 

I^fe-^fe-il <rf, 

Var(Xfc|J-fc_i) = E[(Xfe - Xk-if\Fk-i] < <J^ 
for every k £ {1, . . . ,n}. Then, for every a > 0, 



\Xn ~ Xo\> an) < 2 exp L» 
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where 
and 

D{p\\q)^p\n 



(1-p) In 



^^d 



1-9 



(2) 



(3) 



Vp,(?e [0,1] (4) 



is the divergence (a.k.a. relative entropy or Kullback-Leibler 
distance) between the two probability distributions [p, 1 — p) 
and (g, 1 — q).\f 5 > 1, then the probability on the left-hand 
side of ^ is equal to zero. 

Proof: The idea of the proof of Theorem |2] is essentially 
similar to the proof of ||2] Corollary 2.4.7]. The full proof is 
provided in IJO. Section III]. ■ 
Proposition 1: Let {^fc,-^fc}fcLo ^ discrete-parameter 
real-valued martingale. Then, for every a > 0, 



P(|X„ - Xo\ > a^/^) < 2exp[- — 



i + o( 



(5) 



'Azuma's inequality is also known as the Azuma-Hoeffding inequality. 
Since this inequality is referred several times in this paper, it will be named 
from this point as Azuma's inequality for the sake of brevity. 



where 7 and S are introduced in ([3]l- 

Proof: This inequality follows from Theorem |2] (see ifTOl 
Appendix H]). ■ 

C. McDiarmid's Inequality 

In the following, we state McDiarmid's inequality (see ||6l 
Theorem 3.1]). 

Theorem 3: Let X = {Xi, . . . ,X„) be a family of inde- 
pendent random variables with X^ taking values in a set Ak 
for each k. Suppose that a real-valued function /, defined on 
JIj, Ak, satisfies 

|/(X)-/(X')| <Cfc 

whenever the vectors x and x' differ only in the fc-th coordi- 
nate. Let /i = E[/(X)] be the expected value of f{X). Then, 
for every a > 0, 

F(|/W-Ml>a)<2exp^ 



This inequality is proved with the aid of martingales. It has 
some nice applications which were exemplified in the context 
of algorithmic discrete mathematics (see [6j Section 3]). 

D. Talagrand's inequality 

Talagrand's inequality is an approach used for establishing 
concentration results on product spaces, and this technique was 
introduced in Talagrand's landmark paper |12|. 

We provide in the following two definitions that will be 
required for the introduction of a special form of Talagrand's 
inequalities. 

Definition 1 (Hamming distance): Letx,ybetwo n-length 
vectors. The Hamming distance between x and y is the 
number of coordinates where x and y disagree, i.e., 

n 

rfH(x,y) = ^I{x,^y,} 

1=1 

where / stands for the indicator function. 

The following suggests a generalization and normalization 
of the previous distance metric. 

Definition 2: Let a — (ai, . . . , a„) G M" (i.e., a is a non- 
negative vector) satisfy ||a|p = X]"=i('^i)^ — 1- Then, define 



Hence, dH(x,y) = ^AIda(x,y) for a = . . . , ^). 

The following is a special form of Talagrand's inequaUties 
(&6, Chapter 4], [III, ISl). 

Theorem 4 (Talagrand's inequality): Let the random vector 
X = (Xi,...,X„) be a vector of independent random 
variables with Xk taking values in a set Ak, and let A — 
YYk^i Ak- Let / : A — > M satisfy the condition that, for every 
X G A, there exists a non-negative, normalized n-length vector 
a — a{x) such that 



/(x)</(y)+ad,(x,y), Vy G A 



(6) 



for some fixed value cr > 0. Then, for every a > 0, 



P{\f{X) - m| > a) < 4exp - — 



(7) 



where m is the median of f{X) (i.e., ¥{f{X) < m) > i and 
P{f{X) > m) > i). The same conclusion in (|7]i holds if the 
condition in (|6]l is replaced by 



/(y)</(x)+ad,(x,y), VyeA 



(8) 



Remark 1: In the special case where the condition for the 
function / in Theorem |4] (Talagrand's inequality) is satisfied 
with the additional property that the vector a on the right-hand 
side of (|6]l is independent of x (i.e., the value of this vector 
is fixed), then the concentration inequality in (|7]) follows from 
McDiarmid's inequality. To verify this observation, the reader 
is referred to 16J Theorem 3.6] followed by the discussion in 
p. 211] (leading to ||6l, Eqs. (3.12) and (3.13)]. 

III. Application: Concentration of the 
Crest-Factor for OFDM Signals 

A. Background 

Given an n-length codeword {Xi\^^Q, a single OFDM 
baseband symbol is described by 

s(i;Xo,...,X„_i) = _^X,exp[:^— j, 0<t<T. 

(9) 

Lets assume that X^, . . . ,Xn-i are i.i.d. complex RVs with 
\Xi\ = 1. Since the sub-carriers are orthonormal over [0, T], 
then a.s. the power of the signal s over this interval is 1. The 
CF of the signal s, composed of n sub-carriers, is defined as 



CF„(s) = max \s(t)\. (10) 

0<t<T 

From in Section 4] and lfT4l . it follows that the CF scales with 
high probabiUty Uke •\/log(n) for large n. In ||5l Theorem 3 
and Corollary 5], a concentration inequality was derived for 
the CF of OFDM signals. It states that for every c > 2.5 

clog log(n)' 



CF„(s) - V^og{n)\ < 



= i-o 



{log{n)y 



Remark 2: The analysis used to derive this rather strong 
concentration inequality (see lH] Appendix C]) requires some 
assumptions on the distribution of the Xi's (see the two 
conditions in [|5| Theorem 3] followed by |5] Corollary 5]). 
These requirements are not needed in the following analysis, 
and the derivation of the two concentration inequalities in 
this paper is simple, though weaker concentration results are 
obtained. 

In the following, Azuma's inequality and a refined version 
of this inequality are considered under the assumption that 
{Xj}"^Q are independent complex-valued random variables 
with magnitude 1, attaining the M points of an A/-ary PSK 
constellation with equal probability. 



B. Establishing Concentration of the Crest-Factor via 
Azuma 's Inequality and a Refined Version 

1) Proving Concentration via Azuma's Inequality: In the 
following, Azuma's inequality is used to derive a concentration 
result. Let us define 



=E[CF„(s)|Xo,...,X,_i], 



0, , 



(11) 



Based on a standard construction of Doob's martingales, 
{Yi, J-i}"^o is a martingale where J^i is the cr-algebra that is 
generated by the first i symbols {Xo, . . . , in (|9]l. Hence, 

-7^0 ^ -^1 C . . . C is a filtration. This martingale has also 
bounded jumps, and 



\Y,, - Y,, 



i-l 



< 



for z G {1, . . . ,n} since revealing the additional z-th coordi- 
nate Xi affects the CF, as is defined in ( fTOl ), by at most 
(see the first part of Appendix lAll. It therefore follows from 
Azuma's inequality that, for every a > 0, 



]CF„(s) -E[CF„(s)]| > a) < 2exp - — 



(12) 



which demonstrates the concentration of this measure around 
its expected value. 

2) Proof of Concentration via Proposition [7} In the fol- 
lowing, we rely on Proposition [T] to derive an improved 
concentration result. For the martingale sequence {F^jf^g in 
(fTTI) . Appendix lAl gives that a.s. 



\Y^-Y,A < 



E[(y, < - (13) 



for every i e {1, . . . ,n}. Note that the conditioning on the a- 
algebra Ti-i is equivalent to the conditioning on the symbols 
Xq, . . . , Xi-2, and there is no conditioning for i = 1. Let Zi = 
y/nYi. Proposition [T] therefore implies that for an arbitrary 

a > 



P(|CF„(s)-E[CF„(s)]| >a 
= n\Yn~Yo\>a) 

<2expf-^(l + o(^ 



(14) 



(since S — j and 7 = i in the setting of Proposition [T]). 
Note that the exponent of the last concentration inequality is 
doubled as compared to the bound that was obtained in ( fT2b via 
Azuma's inequality, and the term which scales like O^-^^ 
on the right-hand side of (fT4l i is expressed explicitly for finite 
n (see ifTOl Appendix H]). 

C. Establishing Concentration via McDiarmid's Inequality 

In the following, McDiarmid's inequality is applied to 
prove a concentration inequality for the crest factor of OFDM 



signals. To this end, let us define 

U = maxJs{t-,Xo, . . .,Xi^i,Xi, . . . ,X„_i)| 

,^n-l)\ 

Then, this implies that 



0<t<T' 

y= max \s(t; Xq, X'_-. , Xi, 

0<t<T' 



\U-V\< max s(t;Xo,...,X,_i,X„...,X„_i) 

0<t<T' 



= max —p= 

o<t<T yfn 



s{t; Xq, . . . , Xl_i,Xi, . . . , Xn-i) 
1 N /j27ri<\ 



x,_i-x:_i)cxp 



T I 



(15) 



where the last inequality holds since = l-'^i-il = 1- 

Hence, McDiarmid's inequality in Theorem |3] implies that, for 
every a > 0, 

2 

P(|CF„(s) - E[CF„(s)]| > a) < 2exp(-y) (16) 

which demonstrates concentration around the expected value. 
It is noted that McDiarmid's inequality provides an improve- 
ment in the exponent by a factor of 4 as compared to Azuma's 
inequality. It also improves the exponent by a factor of 2 
as compared to Proposition [T] in the considered case (where 
7 = ^). 

The same kind of result applies easily to QAM-modulated 
OFDM signals, since the RVs are bounded which therefore 
enables to get a similar result to ( fTSl ). 

D. Establishing Concentration via Talagrand's Inequality 

In the following, Talagrand's inequality is applied to prove a 
concentration inequality for the crest factor of OFDM signals. 
Let us assume that Xq, Yq, . . . , F„_i are i.i.d. bounded 

complex RVs, and also for simplicity 

\x.\ = m = 1. 

In order to apply Talagrand's inequality to prove concentration, 
note that 

^max^l s{t;XQ, . . . ,X„_i)| - ^niax^l s{t;Yo, . . . ,y„_i)| 
< ^mfB^I s{t;XQ, . . .,Xn-i) - s{t;YQ, . . . ,r„_i)| 



< 



i=0 
n-l 



< 



1 " ^ 

^ 2—0 

2 

V 1=0 
= 2da{X, Y) 



where 



. 1 



is a non-negative unit-vector of length n (note that a in this 
case is independent of a;). Hence, Talagrand's inequality in 
Theorem |4] implies that, for every a > 0, 

2 

P(|CF„(s)-m„| >a) <4exp(-^), Va > (18) 

where m„ is the median of the crest factor for OFDM 
signals that are composed of n sub-carriers. This inequality 
demonstrates the concentration of this measure around its 
median. As a simple consequence of ( fTSl l, one obtains the 
following result. 

Corollary 1: The median and expected value of the crest 
factor differ by at most a constant, independently of the 
number of sub-carriers n. 

Proof: By Talagrand's inequality in ( fTSl l. it follows that 

|E[CF„(s)] -m„| 
<E|CF„(s)-TO„| 



(a) 



/ P(|CF„(s)-m„| >a) da 
Jo 



- Jo 

where equality (a) holds since for a non-negative random 
variable Z 



/•OO 

E[Z] = ¥{Z > t) dt. 
Jo 



(17) 



Remark 3: This result applies in general to an arbitrary 
function / satisfying the condition in (|6]l, where Talagrand's 
inequality in (|7]l implies that (see, e.g., |6l Lemma 4.6]) 

|E[/(X)] - m| < 4ay/^. 

Remark 4: By comparing (fTsT l with (fTSl ). it follows that Mc- 
Diarmid's inequality provides an improvement in the exponent. 
This is consistent with Remark [T] and the fixed value of the 
non-negative normalized vector in ( fTTI l. 

IV. Summary 

This paper derives four concentration inequalities for the 
crest-factor (CF) of OFDM signals under the assumption 
that the symbols are independent. The first two concentration 
inequalities rely on Azuma's inequality and a refined version 
of it, and the last two concentration inequalities are based 
on Talagrand's and McDiarmid's inequalities. Although these 
concentration results are weaker than some existing results 
from the literature (see |5| and |14l), they establish concen- 
tration in a rather simple way and provide some insight to 
the problem. The use of these bounding techniques, in the 
context of concentration for OFDM signals, seems to be new. 
The improvement of McDiarmid's inequality is by a factor 
of 4 in the exponent as compared to Azuma's inequality, and 
by a factor of 2 as compared to the refined version of Azuma's 
inequality in Proposition [T] Note however that Proposition [T] 
may be in general tighter than McDiarmid's inequality (if 



7 < I in the setting of Proposition [T]i. It also follows from 
Talagrand's method that the median and expected value of the 
CF differ by at most a constant, independently of the number 
of sub-carriers. 

Some other new refined versions of Azuma's inequality 
were introduced in |10|, followed by some applications in 
information theory and communications. This work is aimed 
to stimulate the use of some refined versions of concentration 
inequalities, based on the martingale approach and Talagrand's 
approach, in information-theoretic aspects. 

The slides of the presentation of this work are available at 

mi. 

Appendix A 

Proof of the properties in ([13]) for OFDM signals 

Consider an OFDM signal from Section lTlI-AI The sequence 
in ( fTTT i is a martingale due to basic properties of martingales. 
From ( fTOl ). for every i £ {0, . . . , n} 



max s(<;Xo, . . . ,X„_i) 

0<t<T' 



The conditional expectation for the RV Yi^i refers to the 
case where only Xo,...,X,;_2 are revealed. Let X[_^ and 
Xi-i be independent copies, which are also independent of 

Xq, . . . , Xi^2, Xi,... , Xn-1- Then, for every I < i < n. 



max \s(t; Xn, . . . , 

0<t<T' 



Xl_i,Xi, . . . , Xn-l) 
Xq, . . . , Xi^2 



maxjs{t; Xq,..., X^, . . . , Xn-i)\ 



Xqi ■ • ■ , Xi^2, Xi^i 

Since |E(Z)| < E{\Z\), then for i e {1, . . . ,n} 

\Y.-Y,-i\<^x[_„x,,...,x„_,\\U -V\ I Xo,...,X.-i 



(19) 



where 



U = max \s{t; Xq, . . . , Xi^i, Xi, . . . , Xn-i)\ 

0<t<T' ' 



V = max \s(t: Xo, . . . , X'_-, , Xi 

0<t<T' 



, X,„ 



From ^ 

\U-V\< max |s(t;Xo,...,X,_i,X 



1 

max —= 

o<t<T yfn 



Xn-l) 

s{t', Xq, . . . , X'^_i,Xi, . . . , Xn^i 

j 2Trit 



Xi_i - Xj'_i) cxp 
Xi-i - X-_i| 



T 



(20) 



By assumption, |Xi_i| = |X|_j^| = 1, and therefore a.s. 

2 

Jn' 



|X,_i - X,'_i| <2=^\Y,- r,_i| < 



In the following, an upper bound on the conditional variance 

var(r, I = E[(r, - y,_i)2 1 

is obtained. Since (E(Z))^ < E{Z'^) for a real-valued RV Z, 
then from ([T9]l and 

K[{Y, - <--Ex' ^ [|x,_i - x^L^n j-,] 

where J^i is the cr-algebra that is generated by Xq, . . . , Xi_i. 
Due to a symmetry argument of the PSK constellation, then 
it follows that 

<-E^, J|x,_i-x;_inj-,] 

= -E[|X,_i -X,'_iP|Xo,...,X,_i] 
n 

^-E[\X,^,-XU\'\X^-l] 

n 

= iE[|X,_i-X;_inx,_i-eS 
n L 



1 V I ^ 



4 



M-l 

E 



sm 



mJ ~ n' 
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